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ASYMPTOTIC  (rt)d  JOINT  NORMALITY  OF  SAMPLE  QUANTILES* 

By 

Sadao  Ikeda 

Dept,  of  Economics,  Soka  Univ.,  and  Dept,  of  Statistics,  Purdue  Univ. 


Summary 

Notions  of  asymptotic  equivalence  of  probability  distributions  and 
some  of  their  properties  are  briefly  presented.  By  applying  the  results 
on  type  (u)d  asymptotic  equivalence,  asymptotic  (W)^  joint  normality  of 
a  set  of  increasing  number  of  sample  quantiles  are  discussed,  which  improves 
and  refines  the  previous  work  by  Ideda  and  Matsunawa  (1972). 
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1.  Introduction 

Consider  two  sequences  of  random  variables  {X^t+tp}  and  {Y^t+tg}, 

Xt  and  Yt  belonging  to  for  each  t,  where  t  is  a  parameter  taking 

values  in  a  given  metric  space,  R^  is  any  given  abstract  space,  i*t  is  a 

•-field  of  subsets  of  R.,  and  finally  P(R  j*.)  designates  the  class  of  all 

t  t  t 

random  variables  distributed  over  the  measurable  space  (R^Ji^.). 

Let  us  consider  a  sequence,  {ct;t-*-tg},  of  subclasses  of  corresponding 
Rt's,  and  denote  it  by  (c). 


*The  writing  of  this  paper  was  facilitated  while  the  author  was  visiting  Purdue 
University  in  part  under  the  ONR  Contract  N00014-75-C=0455. 


Keywords : 


2 


Under  the  above  situation,  two  kinds  of  notions  are  defined: 
Definition  1.1  (a)  Two  sequences  of  random  variables  <Xt ;t-*-tQ}  and 

{Yt ;t-^tQ} ,  are  said  to  be  asymptotically  equivalent  in  the  sense  of 
type  (C)d,  and  briefly  denoted  as 


(1.1) 


Xt  %  V^d’^V’ 


provided  that  the  following  condition  holds: 

X  Y 

(1.2)  6d(Xt,Yt;Ct)  =  sup  |P  t(E)  -  P  fc(E) |-0,(t-t0). 

E€C^ 

(b)  The  two  sequences  are  said  to  be  asymptotically  equivalent  in  the 
sense  of  type  (c)r,  and  denoted  as 

(1-3)  Xt  %  Yt(c)r,(t^t0), 

provided  that 

Xt 

i.p  t(.q 


(1.4)  6r(XtYt;ct)  e  sup  -i|^0,(t-t0) 

E€Ct  P  t(E) 


In  case  where  (R^ , )  and  ct  are  fixed  independently  of  t,  a  weaker 
notion  of  asymptotic  equivalence  is  defined  corresponding  to  each  types  of 
the  above  definition.  Let  (Rt^t)  =  (R,li)  and  c t  =  G. 

Defintion  1.2.  (a)  {X^jt+tg}  and  1 are  said  to  be  asymptotically 
equivalent  in  the  sense  of  type  ( (c) >d ,  and  denoted  as 

(1.5)  Xt  ~  Yt((c))d.  (t-t0), 
provided  that 

(1.6)  |pXt(E)  -  pYt(E)|  ^  0,  (t-^tn) 


for  each  E  belonging  to  c. 
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Each  of  the  four  types  of  asymptotic  equivalence  defines  the  corresponding 
type  of  notions  of  asymptotic  independence  and  convergence,  (see  Ikeda  1963,  1968). 

Among  various  types  of  asymptotic  equivalence  defined  above,  type  (B)d 
asymptotic  equivalence  enjoys  very  nice  properties.  By  Def.  1.1,  X^Y^. 

(t-»tQ),  if  and  only  if 

X  Y  ' 

(1.9)  «d(X  ,Y tsB  )  =  sup  [P  fc(E)-P  t(E)|  -  0,  (t-vtj. 

E€Bt  U 

First  we  state  the  following: 

Proposition  1.1  Let  cp^(z)  be  any  given  measurable  transformation  from  (R^b^.) 
to  ( Rt ,B t )  for  each  t,  and  put  Xr  =  <pt(Xt)  and  ?t  =  <pt(Yt).  Then,  Xt  *  Yt(8)d 
implies  Xt  ^  Yt(a)d>  as  t-*-tg.  If,  in  particular,  both  the  spaces  are  identical 
and  cpt  is  non-singular,  then  X^Y^a^  is  equivalent  to  X^^  (e)d,  as  t+tQ. 
Proposition  1.2  Let  (z )  be  a  real,  single  valued  function  defined  over  R^, 
for  each  t.  If  C | (Xt )  |1+4  and  £|ht(Yt)  |  ^+<s  are  both  uniformly  bounded  in  t 
for  some  6  >  0,  then  the  condition  X^Y^b^,  (t-*tQ),  implies  that 
|£  ht ( X t )  -  e  ( Y^ ) )  ->  0,  (t-*-tg),  where  in  general  £  h(X)  =  /R  h  d  PX. 

Some  useful  criteria  for  type  (B)d  asymptotic  equivalence  have  been  given: 
Proposition  1.3  (a)  For  X^Y  (B)d>  ( t-^tQ) ,  it  is  sufficient  that  either  one 
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of  the  following  conditions  holds: 


(1.10)  min{I(Xt:Yt;At),  I(Yt:Xt;At)}  - 

(1.11)  min{W(Xt:Yt;At),  W(Yt:Xt;At)}  - 

Xt 

sequence  of  subsets  such  that  P  ( A^ )  -*■ 
and  W  are  definded  by 


(1.12) 

and 

(1.13) 


kvvv  - 1  ft 

At 

W(Xt:Yt;At)  -  /  9t( 

At 


t’ 


f 


0,  (t+tQ). 

0,  (t+tg).  where  {At;t-*-t0l  is  a 
1  or  P  l(At)  ->1  as  t  +  t.,  and  I 


(b)  For  Xt  Y.  (B)d>  (t-*-tg),  it  is  necessary  and  sufficient  that 

(1.14)  P(Xt.Yt;At)  h  /  {t"t0) 

At 

where  {At>  t  tQ}  is  the  same  as  in  (a)  above. 


Evaluation  of  approximation  error,  6d(xt’Yt’Bt) »  can  be  done  by  using 
either  one  of  the  following  inequalities: 

Propositon  1.4 

(1.15)  0  <  1-p(Xt,Yt;Rt)  <  6d(Xt,Yt;et)  <  { 1 -p2 (Xt . Yt ;Rt ) > 1 /2 

<  (min{I(Xt:Yt;Rt),  I ( Yt : Xt ;Rt ) } ) 1 /2 

<  <min{log(l+W(Xt:Yt;Rt)),  Tog(l+W( Yt : Xt ;Rt ) ) J ) 1/2 

(1.16)  6d(Xt,Yt;»t)  <||  ([l+|min{I(Xt:Yt;Rt),I(Yt:Xt;Rt)}]1/2  -1)}1/2 

<(|«1nU(Xt:»tiRt).l(Yt:XtiRt)))'«. 
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Recently,  Matsunawa  and  Ikeda  (1981)  have  obtained  a  necessary  and 
sufficient  condition  for  Xt  ^  Yt(fl)d,(t->-t0)  to  hold  in  terms  of  the  quantity 

HVW- 

In  the  following  section,  we  shall  specialize  the  notions  of  asymptotic 
equivalence  of  type  (c)^  and  of  type  ((c))^  to  a  special  set  of  subclasses 
in  real  case,  which  are  of  common  interest  in  statistics. 


2.  Asymptotic  equivalence  in  real  case. 

Let  (Xs(n  y>  s  ->  «}  and  {Y^  y,  s  -»■  »}  be  two  sequences  of  real  random 
variables,  X^n  j  and  Y^n  j  belonging  to  P(R^n  )»w(n  ))♦  the  class  of  all 
random  variables  distributed  over  the  ns-dimensional  Euclidean  space,  R^n  y 
with  the  usual  Borel  field  y 

We  take  the  following  sequences  of  subclasses: 

{/^(n  s-1 ,2, . . . }.  y*  s— 1,2,...}  {A^n  s=l  ,2,. . . } , 

(2.1)  s  s  S 

U(n  y,  s=l  ,2, . . . }  and  (8.  y,  s=l,2,...}, 

V  s'  'ns' 

where  we  have  defined: 


% 

§ 

(2.2) 


(n)  = 

lZ(n)l 

1 

8 

A 

r^i 

A 

b^ ;  i  =  1 ,2,. . . ,n;  b.. : 

(n)  = 

(2<»)l 

a.  <  2.  < 

i  i 

bi;  i  =  l,2,...n;  a^.bj 

N 

(n)  = 

{  1  Ej 
j=l  J 

(disjointsum)  jE^S^;  j*l...,N;  N 

(n)  = 

class 

of  all  open 

subsets  of  R(n)* 

Among  the  five  types  of  asymptotic  equivalence,  (tfi)d» (S)^, (A)^, (jfr)^  and 
(«)d,  corresponding  to  the  sequences  in  (2.1),  the  following  implication  relations 


hold: 


In  case  of  general  basic  spaces 


(2.3)  t(B)d,(A)d,U)d}  ^{(S)d}  { (5?0 d  1 , 

and  in  case  of  identical  (or  equal)  basic  spaces  where  (R^n  y  j)  = 

<%)•  8<n>>  for  a"  s' 

(2.4)  {(a)d,(A)d,u)dq;  {(s)d,to)d} 

where  {  }  designates  a  group  of  equivalent  notions,-*-  "imply",  and  -*+- 
"not  necessarily  imply,  counter  example  shown". 

Among  the  five  weaker  types  of  notions,  the  following  implication  diagram 
is  obtained: 

(2.5)  {((B))dJ  -  {(U))dC  {((A))d,((g))d,((7/i))d). 

Some  conditional  implication  relations  have  been  also  obtained  (see  Ikeda 
1968).  Note  that  type  ((^))d  convergence  is  equivalent  to  the  usual  in  law 
convergence,  provided  the  limiting  distribution  is  of  continuous  type,  in 
which  case,  it  is  also  shown  that  ( (57?) )d  and  (#()d  are  mutually  equivalent, 
as  in  the  Central  Limit  Theorem.  Also,  in  many  cases  of  in  law  convergence, 
it  turns  out  that  the  convergence  is  of  type  (fi)d- 

In  the  following  section,  we  shall  apply  the  type  (s)d  asymptotic 
equivalence  notion  to  the  asymptotic  normality  of  a  set  of  increasing  number 
of  selected  order  statistics. 

3.  Asymptotic  (fc)d  joint  normality  of  sample  quantiles. 

Mosteller  (1946)  has  shown,  under  mild  conditions,  that  given  a  spacing 
0<A1  <...<Ak  <1,  the  corresponding  set  of  order  statistics. 


7 


X  <  x 

n,n,  n,n~<...<X  ,  n.  =  [x.n]  +  1 ,  are  asymptotically  jointly  normally 

I  c.  n,n^  i  l 

distributed,  in  a  sense  of  type  ((^))d  in  our  present  terminology,  with  mean 

vector  (F~^(x, ),..., F~^(x  ))  and  covariance  matrix 
<  fc 


(3.1) 


Xi  (1-Xi )  X^l-Xg) 


flf2 

^2  ( 1 


.xi(1-xk} 

fifk 

x2(l-xk) 


Vk 


xk(1‘xk} 


,  fi=f(F‘1(xi)),i=l,...,k 


Later  on,  Weiss  (1969)  has  tried  to  derive  an  asymptotic  distribution,  in  a 
strong  sense,  of  a  set  of  increasing  number  of  sample  quantiles,  and  has 
proved  a  result,  which  is  a  special  case  of  Ikeda  and  Matsunawa  (1972). 

Now,  we  begin  with  the  case  of  uniform  distribution  over  the  unit  interval, 
(0,1).  Let  Un  -|<Un  2<'“<^n  n  be  orcler  statistics  based  on  a  random  sample 


of  size  n  drawn  from  a  uniform  distribution  over  (0,1). 
<U_  _  <  •  •  •  <U 


statistics,  U 

(3.2) 


n,n^  n,n2 


n  ,nk>  and  put 


Un(k)  =  (Un,n1,Un,n2”--’Un,nk)'; 


Select  k  order 


where  k  and  (n^,n2,  .  .  .  ,nk)  may  depend  on  n  as  n  +  •». 

By  applying  the  criterion  (1.10),  Ikeda  and  Matsunawa  (1972)  have  shown 
that  the  following  theorem  holds: 
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(3.3) 


Theorem  3. 1  If  the  condition 
k 

)  W  =  —7—7 - r  - *■ 

'  n  rmn(n^-n^) 

l<i<k+l 


0,  (n  —>•“>) , 


holds,  then  and  Z^j,)  are  asymptotically  equivalent  in  the  sense  of 
type  (b)^  as  n  +  »,  where  stands  for  a  normal  random  variable  with 
mean  vector 


(3.4) 


*n(k)  ^fcnl ,£n2*‘ * ' ,£nk^  ’  with  *ni  =n+l  ’  1-1 ,2, * ' ‘ ,k* 


and  covariance  matrix 


*nl*1_*nl*  *nl*1_V*  *  *  1 


(3.5)  L 


n(k)  n+2 


V^‘*n2^  *  ’  *  *n2^"W 


^nk^'^nk^ 


Here  we  have  taken  a  covention  n,.=0,  n,  ,,=n+l. 

0  k+1 

In  this  case  an  upper  bound  for  the  quantity  <5cj(^n(|() ’^n(k) iJ*(k) ) 
given  by  (1.16): 


(3.6) 
with 

(3.7) 


6d(Un(k);Zn(k);B(k))  =  (l  1  (Un(k):Zn(k);R(k)} )  ^ 


I(Un(k):Zn(k);R(k>)  =  wn  +  0  (wn>' 


The  result  obtained  in  Theorem  3.1  is,  of  course,  extended  to  a 
uniform  distribution  over  any  given  finite  interval,  by  virtue  of  Prop. 1.1 
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Ikeda  and  Matsunawa  (1972)  have  also  obtained  a  result  in  case  of 
general  basic  distribution.  However,  the  conditions  there  are  somewhat 
gloomy  and  not  convenient  to  practical  use.  Moreover,  the  conditions 
include  a  stronger  condition  for  the  spacing  of  (n^,  n^.-.-.n^)  than  (3.3) 


(3.8) 


min(n^-n^  ^) 
1  <  i  <  k+ 1 


Recently,  Ikeda  and  Nonaka  (1981)  have  obtained  a  refined  result,  which 
improves  the  earlier  one. 

Let  X  .  <X  0<.  .  .<X  be  order  statistics  from  a  continious 
n,l  n,2  n,n 

distribution  over  the  real  line,  whose  pdf.  and  cdf.  being  given  by  f(x) 
and  F(x) ,  respectively.  Choose  k  out  of  the  order  statistics,  and  put 


(3.9) 


*n(k)  ”  (Xn,n1 ,Xn,n2’"  * ,Xn,nfc). 


We  shall  first  consider  the  case  where  the  support  of  f(x)  is  identical 
with  the  entire  real  line:  =  (-»,»). 

Then,  the  transformed  variable 

f(W))‘(F(Vn^„,n2) . fn.nj)' 

is  identically  distributed  with  given  in  (3.2),  or. 


is  identically  distributed  with  Xp^j 
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Let  us  consider  a  truncation  of  over  the  domain  =  {z^| 

★ 

O'Z.'l;  i  =  l,2,...,k},  and  denote  it  by  Zn^.  It  is  then  evident  that, 
under  the  condition  (3.3),  Zn^  %  ^n(k)  Further,  let  us  put 

<3-'2>  V)  -F''(W))5  (F''(Z«.l)’  F''(Z^> . r'«,k)): 

and  finally  let  be  a  normal  random  variable  with  mean  vector 

^3-13^  sn(k)  =  ^snl’sn2’“‘,snk^  wlth  sni  =  F  ( ^ni ) »  1  =  1  «2>  •  •  •  »k» 
and  covariance  matrix 


(3.14) 


5n(k) 


1 

n+2 


*nl(1_anl*  4nl ^1_tn2^ 


nl 


fnlfn2 


4n2^1_<n2^ 


n2 


•  '  £nl(1~*nk^ 
FnlFnk 


i  Al-i  .  ) 
n2v  nky 

f  A  . 

n2  nk 


W1-*nk* 

■  D''<fn, . fnk>  L„(k)°‘'(fn, . k„k>’ 


where  we  have  put  f^*  f(spi)  =  f  (F-l  (t  ^  ) ) ,  i  =  l,2,...,k. 


The  following  diagram  indicate  the  relations  among  the  variables  thus 
difined: 

(»)d  (»>d  * 

Un(k)  -  Zn(k)  -  “  zn(k) 

F'1  \l?~] 

t  (8)d  /  ^d  y 

Xn(k)  "  'n(k)  ]  Yn(k) 


(3.15) 
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Under  the  condition  (3.3),  it  holds  that  Un^  ^  ^n(k)  ^d  an<*  there^ore» 

★ 

by  Prop.  1.1,  xn(k)  'v  Yn(k)  ^d’  as  n  ^  “•  Hence,  if  one  can  show  that 
★ 

n(k)  n(k)  (a)d,  (n  °°),  with  possibly  some  additional  conditions, 

then  it  holds  that  Xn^  ^  Yn^  (fl)d>  i.e.,  Xn^  would  be  distributed 

as  normal  with  mean  vector  s  ,  and  covariance  matrix  S  ,, 

n(k)  n(k) 

Ikeda  and  Nonaka  (1981)  investigated  the  quantity  *(Yn(k):Yn(k)»R(k)) 
for  criticizing  the  type  (a)d  asymptotic  equivalence  between  Yn(k)  and  Yn(k)> 
to  get  the  following  theorem. 

Theorem  3.2  Suppose  that  the  following  assumptions  are  fulfilled: 

(i)  The  support  of  f(x)  is  identical  to  the  entire  real  line:  =  (—>,»). 

(ii)  f(x)  is  twice  differentiable  and  f"(x)  is  bounded  and  continuous  over 
the  entire  real  line. 

(iii)  The  function,  c p(x)  =  (f (x)f" (x)-f' (x)2}  /  f(x)2,  is  bounded  uniformly 
for  all  x  in  (  -°°,<”) . 

Then,  in  order  that  Xn^  ^  Yn(k)  0*)d»(n  ®)»  it  is  sufficient  that  the 

following  conditions  are  satisfied  simultaneously: 


(3.16) 


n  nnn(n.j-n.j_i , 
1<  i  <k+l 


0,  (n  , 


(3.17) 


w  .  max{o  . 


5  6 

A  a  o 

4  n  n 


/n+2  n+2 


}  ->  0,  (n  -*  ®), 


where  we  have  put 


(3.18) 


2  _  2  2 
"n  ‘  “ax  °ni  '  an1 


12 


In  case  where  k  and  i  .'s  are  fixed,  the  conditions  (3.16)  and  (3.17) 

m 

are  automatically  fulfilled,  in  which  case,  however,  the  assumptions  (i)-(iii) 
happen  to  be  slightly  stronger  than  those  by  Mosteller  (1946).  In  this  case, 
more  direct  calculation  would  be  possible,  which  will  be  left  open. 

Ikeda  and  Nonaka  (1981)  have  given  a  more  general  result  than  the 
above  theorem,  which  states  the  following  result: 

Theorem  3.3  Suppose  that  the  following  assumptions  are  fulfilled: 

(i)  The  support  of  f(x)  is  identical  to  an  open  interval:  Df  =  (a,b), 
where  a  and  b  are  extended  real. 

(ii)  f(x)  is  twice  differentiable  and  f" (x)  is  bounded  and  continuous  over 
(a.b). 

(iii)  The  function,  cp(x)  s  (f(x)f"(x)  -  f1  (x)2}  /  f(x)2,  is  bounded  uniformly 
for  all  x  in  (a.b). 


Then,  in  order  that  ^  (»)d>  (n 


®),  it  is  sufficient  that  the 


following  conditions  are  satistied  simultaneously: 


(3.19) 

(3.20) 


0,  (n  -*•  °°) . 


0,  (n  -*■  °°). 


and 

a4 

(3.21)  w  -max  j" - - «-"|  -*•  0,  (n  •+•  ®). 

l<i<k[min{|a-snir,|b-snir}J 

It  is  evident  that  this  theorem  implies  the  result  in  the  preceding 
theorem.  Also,  it  should  be  noted  that,  in  order  to  obtain  an  error  estimation 
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for  5d(Xn(k)'Vn(k)’IJ(k)>>  an  eva'ui,t'on  °f  the  K' 
'<Xn(k);,»<k);R(k)>  sh<’uld  be  i0m  direCt’1'- 


L  information 


1 
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